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Discrete Light Color Processor 



TECHNICAL FIELD 

[0001] This invention relates to the field of digital image displays using pixel on-time 
during a frame to produce gray-scale images, and more particularly to a method of increasing 
image brightness or intensity beyond the system's normal dynamic range by using the light 
normally wasted. 

BACKGROUND 

[0002] A new projection display that utiUzes reflections from a large array of micro-mirrors 
(about one million), each mounted above its own semiconductor memory cell and referred to 
herein as a DMD (digital micro-mirror device) is described in IEEE Spectirum, November 1993, 
vol. 30, no. 11, written by JackM.YounseofTexas Instruments Incorporated. The DMD 
comprises a special light modulator that covers each memory cell of a CMOS static RAM witii a 
movable tiny, substantially square or diamond shaped mirror having an edge dimension on the 
order of about 17 micrometers. Electrostatic forces contix>lled by the data in this ceU tilt each of 
tiie mirrors around a pair of axes either plus or minus about 10 degrees, so as to modulate the 
light incident on the surface of the mirror. 

[0003] Other types of image display systems typically create images by emitting or 
modulating light so tiiat the light forms an array of picture elements, or pixels, which when 
viewed together form an image. While most light modulators can create multiple intensity 
levels, a true digital light modulator, such as the DMD cannot. The Ught reflected from selected 
ones of the mirrors passes through a projection lens and creates an image on a large screen. 
Light from the remaining OFF or non-selected mirrors is reflected away from the projection lens 
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and trapped. Without the capability to create multiple brightness levels, digital light modulators 
such as the DMD array rely on a digital pulse-width modulation scheme to create various 
intensity levels by turning a modulator element on and off very rapidly. 

[0004] The portion of time during each video frame that the mirror remains in the on state 
determines the shades of gray (or color intensity) from black, for zero percent on time, to white, 
(or bright color) for 100 percent on time. Color may be added by a color wheel or by using two 
or more DMD's to control or tum a selected set of primary colors on and off. 

[0005] If the DMD device only has the capability to display a low number of digital bits 
representing the on and off times there will be a limited number of shades of gray or shades of 
color, that in tum results in poor video quality. 

[0006] Intensity, or image brightness, is one of many metrics by which display systems are 
judged. The importance of these different characteristics varies depending on the particular 
customer or consumer. Brightness is one metric that is extremely important to purchasers of 
display systems, and therefore, techniques that will improve modulation brightness are important 
in pulse-width modulated display systems. 
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SUMMARY OF THE INVENTION 

[0007] These and other problems are generally solved or circumvented, and technical 
advantages are generally achieved, by preferred embodiments of the present invention which 
provides apparatus and methods for increasing brightness of individual pixels in a digital display 
system wherein intensity or brightness is determined by combining one or more digital bits for 
each display frame. The method and apparatus uses non-standard or secondary bits such as 
spoke bits, which would otherwise be wasted to increase the brightness of a pixel. 

[0008] In accordance with an embodiment of the present invention, the method comprises 

defining an output intensity dynamic range between a minimum level and a maximum level, 

wherein the dynamic range is comprised of a first portion representing an unenhanced dynamic 

range and a second portion representing a dynamic range enhanced by the secondary bits. An 

intensity input signal for one or more of the color signals such as red, green and blue ranging 

from a minimum or zero input level through a threshold input level to a maximum input level is 

received from a source. The input signal typically represents one of the color input signals 

making up a digital color TV or computer input signal. A combination of digital bits from a first 

group of digital bits is selected in response to the intensity or brightness input signal when the 

brightness input signal ranges between the minimum input level and the threshold input level. A 

combination of substantially all of the bits of this first group of bits is selected when the input 

signal is at the threshold level. Typically, the first group of bits will represent 8 binary bits that 

can be combined for 256 levels of output brightness (e.g., 2^=256). A combination of digital bits 

that includes at least one bit of a non-standard or secondary group of bits as well as selected bits 

of the first group of bits is selected for input signals that range between the threshold level and 

the maximum input level. The secondary bits are typically spoke bits that include various hues 
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of green, magenta and yellow. A selected output intensity level of a pixel of the display within 
the first portion of the dynamic range is generated in response to a combination of digital bits 
selected from the first group of digital bits. The output intensity will be at a maximum in the 
first portion when the combination of selected digital bits includes all of the digital bits of the 
first group. Similarly, a selected output intensity level of a pixel of the display within the second 
portion of the dynamic range is generated in response to a combination of digital bits selected 
from both the secondary digital bits and the first group of digital bits. 

[0009] The foregoing has outlined rather broadly the features and technical advantages of 
the present invention in order that the detailed description of the invention that follows may be 
better understood. Additional features and advantages of the invention will be described 
hereinafter which form the subject of the claims of the invention. It should be appreciated by 
those skilled in the art that the conception and specific embodiment disclosed may be readily 
utilized as a basis for modifying or designing other structures or processes for carrying out the 
same purposes of the present invention. It should also be realized by those skilled in the art that 
such equivalent constructions do not depart from the spirit and scope of the invention as set forth 
in the appended claims. 
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BRffiF DESCRIPTION OF THE DRAWINGS 

[0010] For a more complete understanding of the present invention, and the advantages 
thereof, reference is now made to the following descriptions taken in conjunction with the 
accompanying drawing, in which: 

[0011] FIG. 1 is an overall block diagram of a prior art Digital Micro-mirror Display System 
that can benefit from the teachings of this invention; 

[0012] FIG. 2 is a perspective view of a portion of a Digital Micro-mirror Device (DMD) 
array of the prior art; 

[0013] FIG. 3 is an exploded view of the DMD of FIG. 2; 

[0014] FIG. 4 is schematic representation of the bi-stable operation of two mirrors of the 
DMD array of FIG. 2; 

[0015] FIG. 5 is a timeline showing a simplified representation of the subdivision of display 
periods used by the display system of FIG. 4; 

[0016] FIG. 6 is a timing diagram illustrating the on-time of MSB and LSB; 

[0017] FIG. 7A shows a color wheel with R (red), G (green), B (blue) and W (white) 
sectors, and FIG. 7B shows a color wheel with a G sector, a B sector and two R sectors; 

[0018] FIG. 8 is an input/output graph of white light with a single large white bit added 
when an equal value of standard white bits are subtracted to increase brightness without artifacts; 

[0019] FIG. 9 is an input/output graph of white light with three discrete white bits added to 
increase brightness; 
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[0020] FIG. lOA and FIG. lOB illustrate the addition of discrete secondary bits to increase 
brightness according to a prior art algorithm; 

[0021] FIG. 1 1 illustrates the addition of discrete secondary bits to increase brightness 
according to the present invention; 

[0022] FIG. 12 represents a color "volume" using single dimension LUTs (lookup tables) to 
determine the inputs to be provided when secondary or spoke bits are used to increase brightness 
according to FIG. 1; 

[0023] FIG. 13 illustrates a 3D (three dimensional) LUT having red, green and blue single 
dimension inputs; 

[0024] FIGs. 14 and 15 illustrate the use of "Tetrahedral Interpolation" with the "volume" 
of FIG. 12; 

[0025] FIG. 16 illustrates the use of different floating point formats suitable for use with the 
present invention; 

[0026] FIG. 17 is a block diagram illustrating one embodiment of an algorithm for 
increasing brightness according to the teachings of the present invention; 

[0027] FIGs. 18 and 19 illustrate how light pulses applied to the primary colors in the 
algorithm of FIG. 17 may be used in increase brightness; 

[0028] FIGs. 20 and 21 illustrate the use of color "gain" according to the embodiment of 
HG. 17; 

[0029] FIGs. 22 and 23 illustrate the use of "gain" based inputs to single dimension LUT's 
for determining the inputs to a 3D LUT similar to that shown in FIG. 13; 



TI-35625 



-6- 



[0030] FIG. 24 iUustrates a 3D "gain" based LUT; 

[0031] HGs. 25, 26 and 27 illustrate "Dynamic Range Adjust" circuitry suitable for use 
with the embodiment of FIG. 17; and 

[0032] HGs. 28 and 29 illustrates WSSP (White Secondary Spoke Primary) circuitry 
suitable for use with the embodiment of FIG. 17. 
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DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS 

[0033] The making and using of the presently preferred embodiments are discussed in detail 
below. It should be appreciated, however, that the present invention provides many applicable 
inventive concepts that can be embodied in a wide variety of specific contexts. The specific 
embodiments discussed are merely illustrative of specific ways to make and use the invention, 
and do not limit the scope of the invention. 

[0034] Referring to FIG. 1, an example of a DMD (digital micro-mirror device) system 10 is 
illustrated, wherein the Ught from a Ught source 1 1 is applied through a first condenser lens 13 
and through a color wheel 15, which will typically rotate no less than about 60 revolutions or 60 
frames per second. Alternately, the color wheel 15 may make up to five or six revolutions per 
frame or about 300-350 revolutions per second. The light passing through the color wheel 15 
passes through a second condenser lens 17 onto a DMD chip 19. The DMD chip includes an 
array (on the order of one million) of tiny mirror elements, or micro-mirrors, where each mirror 
element is hinged by a torsion hinge and support post above a memory cell of a CMOS static 
RAM as shown in FIG. 2 and FIG. 3. 

[0035] FIGs. 2 and 3 show a portion of a typical DMD array 19 having mirror elements 21 
suspended over a substrate 23. Electrostatic attraction between the mirror 21 and an address 
electrode 25 causes the mirror to twist or pivot, in either of two directions, about an axis formed 
by a pair of torsion beam hinges 27a and 27b. Typically, the mirror rotates about these hinges 
until the rotation is mechanically stopped. The movable micro-mirror tilts into the on or off 
states by electrostatic forces depending on the data written to the cell. The tilt of the mirror is on 
the order of plus 10 degrees (on) or minus 10 degrees (off) to modulate the light that is incident 
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on the surface. For additional details, see U.S. Pat. No. 5,061,049 entiUed "Spatial Light 
Modulator" and U.S. Pat. No. 5,280,277 entitled "Field Updated Deferrable Mirror Device," both 
by Larry J. Hombeck. 

[0036] Referring again to HG. 1, the light reflected from any of the mirrors may pass 
through a projection lens 29 and create images on the screen 31. The DMD's are controlled by 
electronic circuitry fabricated on the silicon substrate 23 under the DMD array. The circuitry 
includes an array of memory cells, typically one memory cell for each DMD element, connected 
to the address electrodes 25. The output of a memory cell is connected to one of the two address 
electrodes and the inverted output of a memory cell is connected to the other address electrode. 
Data is provided by a timing and control circuit 33 determined from signal processing circuitry 
and an image source indicated at 35. Once data is written to each memory cell in the array, a 
voltage is appUed to the DMD mirrors 21 creating a large enough voltage differential between 
the mirrors 21 and the address electrodes 25 to cause the mirror to rotate or tilt in the dkection of 
the greatest voltage potential. Since the electrostatic attraction grows stronger as the mirror is 
rotated near an address electrode, the memory cell contents may be changed without altering the 
position of the mirrors once the mirrors are fully rotated. Thus, the memory cells may be loaded 
with new data while the array is displaying previous data. 

[0037] DMD arrays are typically operated in a dark-field mode. In one embodiment of 
dark-field operation shown in HG. 4, light 1 la from light source 1 1 is focused on DMD array 19 
and strikes the DMD array 19 at an angle. According to the example shown in HG. 4, when 
tilted or rotated to an ON position as indicated by mirror 21a, light incident the mirror 21a will 
be reflected and focused onto a viewing screen 3 1 or image plane where it will form part of the 
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image. If a mirror 21b is rotated away from the light source to an OFF position, light incident 
the mirror 21b will reflect away from the viewing screen 31 and will not form part of the image. 

[0038] Light incident ON and reflected from a DMD mirror forms an illuminated dot on the 
viewing screen 3 1 for every mirror 21 that is rotated to the on position. Each of these dots 
represents one picture element, or pixel, which is the smallest individually controllable portion of 
an image. Using a large array of these tiny mirrors, an image is created by selectively turning 
some mirrors to the on position while turning some to the off position, thereby creating a pattern 
of illuminated dots on the viewing screen. 

[0039] To create multiple intensity or brightness levels, or shades of gray, the duty cycle of 
each mirror is altered by rapidly rotating the mirror on and off in response to a series of digital 
pulses having different widths or durations (i.e. PWM) that are determined by the timing and 
control circuit 33 from the received image signal. This creates a pixel that, during a specific 
period of time or "fi^e," consists of a series of illuminated periods and non-illuminated periods 
that will vary for each pixel. The viewer's eye integrates these periods for each pixel so that the 
viewer perceives a collection of illuminated dots, each having a brightiiess or intensity 
proportional to the duty cycle or ON time of the mirror. 

[0040] Full-color images are created by rapidly displaying multiple monochromatic images, 
typically red, green, and blue, and once again allowing the viewer's eye to integrate a series of 
these different color images. Depending on tiie cost and required image quality of the projection 
system, die monochromatic images may be projected sequentially or simultaneously. As stated 
previously, the portion of time during which the video frame that a mirror remains in the on state 
determines the shade of gray (or color brightness). The time duration in which the cell is on is 
determined by a series of data bits (such as 8 bits, 16 bits, etc.) sent to that cell. The color wheel 
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15 is divided into different color sectors, such as for example only red, green and blue. It should 
also be understood that there could be more than three colors on the wheel. Furthermore, to 
boost brightaess a clear sector (white light) could be used. However, simply including more 
white light will also result in saturation of colors. It should also be understood that it is not 
necessary that each of the color sectors of the wheel be of the same size. It is not even necessary 
that there be the same number of sectors for each color. 

[0041] In the color wheel example of HG. 1 , the maximum red for a pixel would be when a 
micro-mirror reflects light (red) for the full period or position of rotation that Ught is projected 
through the red sector. The minimum color (black) would be when the light incident to a 
specific micro-mirror remains OFF during a full rotation of the color wheel 15. That is, the 
mirror would not be reflecting any light received from the color wheel and the lens, etc. at all to 
the screen 31 during the color cycle or frame. The intensity resolution in a pulse-width 
modulation (PWM) scheme is limited by the response time of the DMD mirrors. The total time 
available to display a color frame and the least time required to turn a mirror to the ON state and 
back to OFF state defines the resolution of present systems. In an arrangement Umited to 8 bits, 
the most significant bit, as illustrated in HG. 5, is the 7th bit having reference number 37 with 
that bit representing the widest ON time, the 601 bit having reference number 39 as tiie next 
widest ON time, and the 5th bit representing the tiiird longest ON time, etc., all the way down to 
the least significant 0 bit, which is represented by the shortest time period 41. As an example 
only, and again referring to FIG. 5 and assuming that a sequential color DMD system has a fixed 
period of X-msec (milliseconds) available for a specific primary color in die display frame, the 
max on time would be X which is tiie sum of all 8 bits for an 8 bit binary PWM system. The 
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least ON time (i.e., other than zero sec ON time (i.e. black color) would occur when "only" the 
least significant bit 41 is tumed "on." 

[0042] More specifically, FIG. 5 illustrates a timeline showing a typical sequential color 
binary pulse- width modulation data stream. In FIG. 5, each frame period 43 is comprised of 
three sub-frames 45, 47 and 49, where each sub-frame is a period in which the color wheel 15 of 
FIG. 1 outputs red green and blue monochromatic light. Each sub-frame is further subdivided 
into bit periods as was discussed above. During each bit period the DMD mirrors are set to the 
ON or OFF position depending on the image data written into the DMD by the timing and 
control circuit 33 of FIG. 1. As discussed above, FIG. 5 shows a simple bit sequence for one 
"binary" 8 bit color word of a three color image system in which each bit is displayed for twice 
the period of the previous bit. That is, bit "1" is twice as large as bit "0," and bit "7" is twice as 
large as bit "6." However, it should be noted that FIG. 5 is for illustration only and bits "6" and 
"7" have been truncated to save space on the drawing. In addition, some applications may not be 
binary. For example, the order in which the bits are displayed may be altered, or the longer bit 
periods may be divided into two shorter, non-consecutive bit periods. Furthermore, some 
systems split one or more of the color sub-frames such that some of the data bits are displayed 
during one sub-frame while others are displayed in another sub-frame. 

[0043] As mentioned above, image brightness is often of utmost importance to consumers of 
video displays. Thus, insufficient brightness of a display is simply unacceptable. Therefore, it is 
highly advantageous to increase the intensity or brightness of a display, and one method is to 
adjust the bit display periods to more efficiently utilize the frame period. For example, by 
foregoing purely binary bit periods, brightness may be maintained without exceeding the 
allowable bit display period. 
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[0044] The brightness or intensity of a display is of particular importance, and may 
dominate all other considerations. For example, for a presentation of data such as charts, etc., 
color or hue is used primarily to distinguish numbers, data sets or line depth, etc. Consequently, 
the acmal color of a chart or number, etc., is not of great importance so long as it provides clear 
delineation from an adjacent number, bar graph, or chart, etc. Therefore, other than avoiding 
unpleasant or irritating colors, faithful representation or reproduction of colors is of minor 
importance for this type of display if the brightness of the presentation is sufficient that it can 
take place in a room with full light. On the other hand, for other types of displays such as 
movies, faitiiful reproduction of colors is extremely important. Altiiough brightness or intensity 
is also important, the problem of brightness is typically handled by simply darkening the room 
when running the display or movie. At least for the present, customers do not expect to watch a 
movie or most displays in fiiU daylight. 

[0045] Of course the ideal display will provide sufficient brightness and faithful 
reproduction of color. Due to many reasons, including cost, heat load, etendue, etc., it is not 
feasible to simply increase the amount of light available for use with a DMD. For example, the 
projection lamp used with a DMD display to provide the light remains on all of the time and 
typically generates a substantial amount of heat that needs to be dissipated. Therefore, if the 
display also included a substantial amount of pure monochromatic areas, tiie unused light from 
the pixels when tiie color wheel provides a different monochromatic color of light than the 
selected monochromatic light will be reflected away firom the screen and absorbed. 
Consequentiy, there can be an unacceptable heat buildup if the projection lamp output is 
significantiy increased. 
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[0046] However, if some of the light that is typicaUy reflected away from the screen by the 
DMD could be used to boost the brightness of the display while maintaining the proper color, 
then more of the total available light could be used and the thermal budget improved. 
[0047] As was mentioned above, simply adding a clear sector to the color wheel (white 
light) and selectively turning on the appropriate mirrors will increase the brightness of the image. 
However, other techniques for using otherwise wasted light to boost brightness without reducing 
contrast to an unsuccessful level, or causing other artifacts, have been developed. For example, 
referring now to FIG. 7 there is shown a color wheel 53 with red 55, green 57, blue 59, and white 
61 sectors. FIG. 7 also shows a spot or area 63 on color wheel 53 representing the "footprint" of 
a light beam projected through a color wheel. Thus, it will be appreciated that since the spot or 
area of Ught 63 has an actual diameter or dimension, there wUl be a transitional portion or spoke 
65 of the color wheel when the light is not the same color as one of the color wheel sectors. For 
example, assuming a clockwise rotation, the wheel 53 will move firom a portion of the wheel 
where only white light is projected through sector 61 to a transitional or spoke area 65 where the 
white light diminishes and green light increases until the spot 63 is totally over the green sector 
57. If the transitional sector or spoke 65 is defined as a single bit 67, it will be appreciated that 
the composite color for this spoke or transitional sector 65 is not a single sector color but is 
comprised of green light and white light. In a similar manner, there will also be a spoke 69 
composed of blue light and white light, spoke 71 composed of blue light and red light (magenta), 
and spoke 73 composed of red light and green light (yellow). 

[0048] As was mentioned above, the color wheel could also include more than one sector of 
a selected color. For example, the color wheel may include two red sectors, such as sectors 55a 
and 55b shown in FIG. 7B to reduce an artifact referred to as "color separation." This artifact 
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uses the eye to see a rainbow of colors when the eye moves, and results when colors are not 
presented to the eye in a rapid enough sequence. Thus, in the embodiment of FIG. 7B, there can 
be double the number of bits available to show red colors as are available for green and blue. 
However, in this embodiment, magenta and yellow spokes are available to boost the overall 
brightness. 

[0049] Referring now to FIGs. 8 and 9, present techniques for using white light and 
recapturing "spoke" light in an 8 bit system are discussed. FIG. 8 illustrates how a single white 
bit of light may be added. As shown, the horizontal axis 75 of FIG. 8 represents the input signal 
for white light and the vertical axis 77 represents the light output. The dotted line 79 represents 
the maximum Ught output when all bits (0-255) for the three colors, red, green and blue, are ON 
thereby combining to create white light. That is, for a basic system where light boosting 
techniques are not used, line 79 represents the maximum possible light output. However, if for 
example the color wheel includes a white or other color sector, a non-standard or white bit 81 
representing white light could be added to the 255 levels. Of course, if the white sector bit was 
simply added to the existing 255 bits at some point 82, the brightness increase would be a step 
function followed by further brightness increases as indicated by dotted lines 83. Such a sudden 
increase in brightness would create an unacceptable artifact that for most uses would be worse 
than having insufficient brightness. Therefore, typically non-standard bit 81 is not turned on 
until the total output level is at least two times the value of the white bit 81. At that point, a 
portion of the 255 output levels equivalent to the white bit 81 is turned off at the same time the 
white bit 81 is turned on. Thus, there is no step function increase of the light. Further, all of the 
light levels that were turned off and any color levels that had not yet been turned on at the time 
the non-standard bit 81 was added, are avaUable to further increase the light output not only up to 
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the 255 bit level output indicated by dotted line 79, but beyond dotted line 79 up to a second line 
85 representing a light output equal to all 255 normal bit levels plus non-standard white bit level 
81. Thus, a significant increase in brightness can be achieved. 

[0050] Unfortunately, as can be seen from ¥IG. 8, the Ught increase ramp or dynamic range 
is not linear and even though there is not a step increase of light when bit 81 is added, there is an 
inflection point 93 where the white bit 81 was turned on such that the light increase is at a 
steeper rate than before bit 81 was added. Thus, although providing significant improvement in 
brightness and a definite improvement over some techniques, this inflection point 93 may also 
create a noticeable and unacceptable artifact. 

[0051] Referring again to FIG. 7 A and as discussed above, there are non-monochromatic 
unused Ught bits or non-standard bits generated during the transitional areas or spokes 65, 69, 7 1 
and 73. In a manner somewhat similar to tiiat discussed above, this '-unused" light may also be 
used to boost brightness. Therefore, in the following discussion, it is assumed that the non- 
standard bits representing the spokes are combined in the right proportion to produce white Ught 
and, it wiU be appreciated by those skilled in the art that the technique is also applicable to color 
or hues other than white Ught such as yellow, magenta and cyan. 

[0052] Therefore, referring now to FIG. 9, there is shown an mput/output light graph of the 
dynamic range similar to that discussed with respect to FIG. 8 except tiiere are three smaller Ught 
bits 87, 89 and 91 rather than tiie single large Ught bit 81 of FIG. 8. The process of adding the 
light bits is the same as discussed with respect to HG. 8 except equivalent bits are turned off 
tiiree different times as the three spoke bits are added, and there is stiU a single inflection point 
93 where the first bit is added. It is important to note, however, tiiat even though the total 
amount of Ught added in HG. 9 with tiie tiiree bits is the same as added in HG. 8 with a single 
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large bit, the three bits 87, 89 and 91 are added at three different times. More specifically, FIG. 9 
shows a typical input/output white (i.e., R=G=B) ramp signal, and how the addition of bits 87, 89 
and 91 changes the final light output brightness. As shown, the output/input white ramp or 
dynamic range without adding the spoke hue bits 87, 89 and 91 is straight line 95 extendmg from 
the "0" input 97 to a maximum output value 99 as also indicated by line 101. This is the light 
that is available if all 8 bits (255 levels) are turned on. Although the input/output line 95 or 
dynamic range is shown as being a straight or a linear line it will be appreciated that the line is 
actually a series of 256 tiny "steps." However, a straight line is perceived. Typically, 14 to 17 
bits would be required to create enough steps so that the discrete steps could not be seen. 
However, as will be appreciated by one skilled in the art, we actually have 8 bits + N fractional 
bits (or 255.XXXXX levels), and by only displaying the integer portion and dithering the fractional 
portion, the effective presentation to the eye is 14 to 17 bits of resolution. 
[0053] If the output value of the three bits 87, 89 and 9 1 added together is equal to "W" as 
indicated by dimension 103, the total maximum output as indicated by point 105 and Une 107 
will be equal to the standard R=G=B values indicated by line 101 plus the value of "W" as 
indicated by dimension 103, and the ideal ramp or even distribution across the dynamic range 
would be the dashed straight line 1 1 1 extending from the starting point 97 to the maximum point 
105. However, the first non-standard spoke bit 87 having a value "X" cannot be added until the 
standard (R=G=B) output value is equal to 2X and consequently the output does not follow the 
ramp or slope line 111. Instead of following Une 111, the resulting output follows the original 
output ramp line 95 until the first bit 87 is added at inflection point 93 and then follows the ramp 
line 1 1 la to end point 105. Adding the non-standard bit 87 only after the standard (R=G=B) 
ramp value is equal to 2X allows a value exactly equal to "X" to be subtracted at the same instant 
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spoke bit 87, which has an "X" value is added. Although a substantially reduced artifact at 
inflection point 93 is still present, there are no additional artifacts caused by the process of 
subtiracting and adding equal values to the ramp. In a similar manner, bit 89 is added where Une 
95 representing the original ramp signal increases an additional amount "Y" equal to the output 
value of the second spoke bit 99. At this point, an output amount "Y" is subtracted at the same 
instant the bit 89, having an output value of "Y" is added. Similarly, the spoke bit "Z" is added 
after the output has increased an additional amount equal to the value "Z." 
[0054] Although the above-described process of adding the non-standard bits 87, 89 and 91 
provides the desired increase in brightness without a very noticeable artifact as was discussed 
with respect to FIG. 8, there is still an artifact that occurs due to the rate increase of light output 
at inflection point 93. The inflection point 93 still exists when the algorithm is used because ttie 
addition of tiie bits 87, 89 and 91 are not distiibuted over the first portion of the input/output 
ramp. As was discussed above, it should also be appreciated that tiie same process of adding 
brightness can also be used with respect to tiie secondary colors cyan, yellow and magenta, as 
well as white. 

[0055] From the above discussion, it is seen tiiat a primary difficulty with the presently used 
algorittmi is tiiat ttie gain of tiie white (or secondary color) can only be used after the non- 
standard discrete spoke bit is turned on. This is because the present algoritiim can only subtiact 
from tiie RGB signals. If it is allowed to add to tiie RGB signals, tiien tiie yellow to white ramp 
(which has red and green at full on throughout the ramp) would not be able to show the increase 
to tiie R and G signals because tiiey are already at maximum. The resulting discontinuity would 
also occur at inflection point 93 where the first discrete bit is tiimed on. 
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[0056] Although the above discussion was with respect to "white" light, the process, of 
course, increases the full color spectrum. However, the problem remains that an inflection point, 
such as the inflection point 93, wUl occur with respect to the three primary colors as well as with 
"white" light. Consequently, there are colors or hues that cannot be exactly reproduced using the 
above algorithm. 

[0057] FIG. lOA is a "RGB" color "cube" indicatmg this problem. As shown, the basic 
RGB system (i.e., no spoke bits added) is represented by the smaller cube havmg comers or 
points 115, R (red), G (green) B (blue), Y (yellow), C (cyan), M (magenta) and W (white). The 
larger cube 1 15 or R' , G' , B' , Y' , C , M' and W represent a presently unattainable "perfect" 
color distribution using secondary or non-standard bits to increase brightness. It will be 
appreciated that the white light is along the diagonal 1 17 extending from the 0, 0 point 1 15 to the 
W point. However, because the "rate change" in brightness begins at the inflection point and is 
not spaced over the entire input, only portions of the larger cube, as shown in FIG. lOB, can be 
realized using the existing prior art algorithm. 

[0058] Referring to HG. lOB, it can also be seen that the increased brightness cannot be 
realized at those comers of the small cube that represent only basic colors. This is illustrated by 
the increased areas or pyramid-shaped portions shown in dotted lines in FIG. lOA at the C, Y, M 
and W comers of the cube and the absence of such pyramid-shaped portions at the basic R, G, 
and B comers. This is because there must be enough Ught of each of the RGB colors making up 
the desired color to match the secondary color light or non-standard bit being turned on. Since 
each of the non-standard secondary or spoke bits will include at least two of the basic colors and 
since a display of a single basic color will not include the other two basic colors, there is nothing 
to subtract from and consequently the secondary or spoke bit cannot be added without altering 
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the hue of the display. Therefore, an algorithm that would create a Ught boost by applying the 
additional non-standard discrete light bits such as the spoke bits over the largest part possible of 
the color gamut is needed. Further, to reduce PWM (pulse-width modulated) artifacts caused by 
subtraction of the discrete white, spoke or secondary color bits for the RGB levels, the algorithm 
should avoid turning on those bits until the RGB signals are at a high intensity level. 

[0059] These advantages are accomplished according to the present invention by calibrating 
the maximum gain that can be applied to each of the R, G and B signals when the non-standard 
discrete spoke bits are used. Then, when the required R, G, B signals exceed the maximum level 
of the dynamic range available from the standard 8 bits, the discrete spoke secondary color (or 
white) bits are substituted. This process may be better indicated by referring to FIG. 1 1 which 
again shows the addition of three white bits. As shown, FIG. 1 1 is somewhat similar to FIG. 9 
except the spoke bits are not added until the output has reached its nominal dynamic range (i.e., 
all 8 bits or 255 levels are ON). Elements of FIG. 11 that are the same as in FIG. 9 carry the 
same reference numbers. For example, secondary or spoke bits 87, 89 and 91 are to be added to 
the standard (0-255) RGB bits which result in a maximum intensity output indicated by dotted 
line 101. However, to avoid an inflection point and the corresponding artifacts as was discussed 
with respect to FIG. 9, the maximum possible output value (or dynamic range) of the 8 bits plus 
the non-standard spoke bits 87, 89 and 91 is determined. This maximum value at point 105 is 
also indicated at hne 107. The necessary gain factors for the output to each input value 
(assuming white light and that R=G=B) to provide a straight line 131 at a constant rate from 
beginning point 97 to maximum output 105a is then computed as will be discussed in detail 
hereinafter. However, it is seen that the light output as a function of the input reaches the 
maximum (dynamic range) value possible from the standard RGB bits as indicated at line 101. It 
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is specifically noticed that the maximum light output as indicated at Une 101 is reached well 
before the input actually calls for a maximum output as occurs at point 135. Thus, so long as the 
input signal stays below the value at point 133, the system operates at much higher output 
without adding any additional bits. However, if an input light signal is received that is greater 
than that at point 133, the system wUl be at a maximum (i.e., saturated) if there are no non- 
standard secondary bits, pulse or spoke, are available. Thus, according to the present invention, 
when an R, G or B signal reaches its dynamic range (i.e., line 101 in FIG. 1 1) discrete non- 
standard spoke or secondary color bits are added as the equivalent value in standard bits (i.e., 
appropriate ones of the 0-255) is subtracted. As shown in HG. 11 at point 133 on the input 
(horizontal) axis, the signal output represented by line 131 has reached its full dynamic range. 
Therefore, as an example only, a selected group of 255 standard bits that is equivalent to bit 87 
which has a value of "X" is subtracted or turned off at the same time bit 87 is added as indicated 
by reference number 137. Thus, the bits that were tumed off are now available to add back in as 
the input signal is increased to an even greater value. In a similar manner, bit 89 having value 
"Y" and bit 91 having a value "Z" are subtracted so that at the maximum input value indicated at 
point 135 on the horizontal axis, the output value wUl be at point 105a or the output level 
indicated by line 107. Thus, from a "0" input value to the maximum input value identified by 
reference number 135, the output provides a linear gain without an inflection point up to the 
value 105a or level 107. Therefore, according to the present invention, the light generated during 
the transitional areas or spokes can selectively be added to the pixels during a display frame to 
increase brightness or intensity substantially without creating artifacts. 
[0060] The above discussion was with respect to white light. However, it should be 
appreciated that the gain factor must be adjusted for each of the system's primary colors 
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according to the input signals location in the RGB color cube, to be discussed, such that when 
the input signal is near the white diagonal (i.e., R=G=B), the gain can be the maximum value as 
just discussed. However, when the input signal is near a pure or basic primary color, such as an 
R, G or B signal, the gain will remain around unity. The primary signals can be increased in the 
same manner as white if a region of the color wheel has light that is made up of only the pure 
color, but can change over time (i.e., a lamp pulse) or changes are difficult to predict due to 
manufacturing tolerances (e.g., neutral density filters on a color wheel). A gain can be applied to 
the primary color, and these primary color bits can be substituted so as to provide a primary color 
boost. Consequentiy, instead of the ideal situation represented by a larger color cube as 
indicated by dotted lines in FIG. 12, the available gain is represented by the heavy lines which do 
not define a true cube. That is, the gain is unity for the primary RGB colors but increases to 
maximum for white light. There will also be substantial increases for the yellow, cyan and 
magenta colors but these increases will not be as great as the increases available for the pure 
white Ught. However, it should also be appreciated tiiat colors other than RGB could be selected 
as the "primary colors." For example, if yellow, cyan and magenta were selected as the primary 
colors, the gain for these colors would be unity, whereas the intensity of tiie red, green and blue 
colors would be increased. In any event, it can be seen that the available color and intensity of 
the system represented by the heavy lines in FIG. 12, although not as great overall as tiie larger 
cube, still covers a substantially greater portion of the color spectrum and is a significant 
improvement over tiie system represented in FIG. lOB as is obvious by comparing the figure of 
lOB with the figure indicated by heavy lines in FIG. 12. 

[0061] One embodiment of the present invention uses a 3D LUT (lookup table) to store the 
"gain factor" on a 3D grid of points covering tiie entire RGB color volume or cube. Referring 
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now to FIG. 13, there is a representation of the 3D LUT. The "large cube" represents the 
complete set of values in the "cube" and is subdivided into smaller "cubes" as shown. The term 
"cube" is used for convenience since three dimensions of the 3D structure may not be equal. For 
example, the sides or three dimensions of the sub-cubes are illustrated as being of equal length. 
However, it is not necessary that the three dimensions be equal. Therefore, the proper term is 
"parallel piped" rather than cube. Further, it should be understood that although for explanation 
purposes HG. 13 illustrates only four "cubes" or parallelepipeds of equal size along each of the 
R, G and B axes for a total of 64 sub-cubes, that there may be substantially more than four cubes 
along each axis (such as for example, 16 cubes) and in fact, they may be parallelograms having 
different sizes or dimensions along all, one or a single dimension. The input signals determine a 
sub-cube within the large cube and then a final output gain value is determined by interpolation 
(typically linear interpolation). Thus, for each color of each of the input signal values, a gain is 
calculated. Thus, a gain value gR is calculated for red, a gain value gG is calculated for green 
and a gain value of gB is calculated for blue. The size and starting point of each "cube" 
(parallelepiped) is determined by an input one-dimensional LUT on each of the three inputs. 
Thus, the LUT maps the input of the appropriate sub-cube within the large cube and can be either 
a full-sized LUT, as determined by the presence of the input signal, or it may be a smaller LUT 
which is associated with appropriate hardware (e.g., a binary search engine) to find the entry 
point used to map into the 3D LUT. The embodiment using a binary search table uses less 
memory and requires only four stages of search and will be discussed in detail hereinafter. 
[0062] It should also be understood that "input formats" to the 3D LUT other than RG and 
B may be used. For example, a "color ratio" input format discussed hereinafter, as well as 
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intensity formats, which provide for hue solutions and intensity wrapping may be used. Intensity 
formats provide an easier method to maintain a constant hue overall intensity level. 
[0063] Referring again to FIG. 13, there is illustrated an example wherein a specific RGB 
input locates or determines that cube 1 19 contains the appropriate gain factor for the input signal. 
Thus, once the appropriate sub-cube (e.g., cube 119 in the present example) is determmed, the 
acmal gain value must be determined. Since the number of values in the LUT is finite and the 
number of input RGB signal possibilities may be substantially infinite, the final value for the 
appropriate gain may be determined by interpolation. Tetrahedral interpolation has been found 
to be particularly suitable with the present invention. A complete and full discussion of 
Tetrahedral interpolation may be found in U.S. Pat. No. 4,275,413 issued to Sakamoto, et al on 
June 23, 1981. However, for purposes of the present invention, Tetrahedral interpolation slices 
each of tiie sub-cubes (actually a parallelogram) into six Tetrahedrons illustrated in FIG. 14. As 
was mentioned above, tiie RGB values determine the appropriate sub-cube. However, the RGB 
values also may be used to determine the appropriate one of the six Tetrahedrons. Once the 
appropriate Tetrahedron is determined, the gain factor for the red, green and blue signals may 
then be calculated using a three dimensional linear interpolation. 

[0064] For example, in the example of FIG. 13, it is assumed that Tetrahedron Tl of HG. 
14 was selected based on the red, green and blue inputs. FIG. 15 is anotiier view of the 
Tetrahedron Tl witii each of the R, G and B axis illustrated and the input value indicated on each 
axis. Thus, using the value or point shown in HG. 14. tiie output gain for red can be computed 
from equation 1. 
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Equation 1: 

gr(x,y,z)=grooo+(gri()o-gr()oo)(R-Ro)\(RrRo)+(griio-grioo^ 
(G-Go)\(Gi-Go)+(griirgriio)(B-Bo)\(BrBo) 

[0065] Thus, only the four red gain values rooo, fioo, rno and rm are used in the interpolation. 
Therefore, these values, along with Ro, Go and Bo values along with reciprocal of the cube size 
can be stored in the input LUT such that multiplication can be used in the calculation rather than 
division. Consequently, the interpolation equations for the red gain can be written in general 
notation as shown in equation 2 that will support a location in any of the six Tetrahedron. 

Equation 2: 

gc(xyz)=gcooo+Ci(R-Ro)\(Ri-Ro)-K:2(G-Go)\(GrGo)HK:3(B-BoK^ 

[0066] The same process is used to provide the same type general equations for determining 
the gain for the green signal and the blue signal. 

[0067] The Ci, C2, C3 terms are determined from Table 1. A gain, gc, is computed for each 
color where c=red, green and blue using the gains stored in the 3D look-up table. This gain is 
then applied to the input RGB values. 



Tetrahedron 


Test 


c, 


C2 


C3 


Tl 


AR>AG>AB 


5^100 ~ ^^000 


^^110 ~ ^^100 


8^ui ~ 8^110 


T2 


AR>AB>AG 


^^100 ~~ ^^000 


^^111 "~^^101 




T3 


AB>AR>AG 


^^101 ~ ^^001 




^^001 ~ ^^000 


T4 


AG>AR>AB 


8^m ~ ^^010 


^^010 "~ ^^000 




T5 


AG>AB>AR 




^^010 ^^000 


g^ou ~ 8^0X0 


T6 


AB>AG>AR 


8^n\ ^^011 


5^011 ~ ^^001 


8^m ~ 8^000 



Table 1. 

[0068] One implementation of the above-described algorithm uses a floating point number 
representation to reduce the amount of required memory. Therefore, three floating point number 
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formats have been developed for use with the algorithm of this invention. It should be 
understood, however, that the use of a floating point format is not necessary to make the present 
interpolation method work. For example, scaled mteger math could also be used, and that the 
described floating point format represents only one method of complementing the 3D LUT 
storage and interpolation. 

[0069] The first format, FP_7e5_20 is a non-negative floating point number with a 
normalized 7 bit mantissa and a 5 bit exponent biased by 20. The value equals 0.0 when the 
exponent equals 0, and the range of numbers for this format is 1.90735e-6 to 4080. 

[0070] The second format, SFP_7e5_20 is a signed version of the FP_7e5_20 number 
representation discussed above, and the third format PFP_7e2_l is a positive floating point 
number witii a normalized 7 bit mantissa and 2 bit exponent biased by 1. There is a "no 0" code. 
The range of numbers for this format is 0.5 to 7.96875. This format will be used when 
multiplying by FP_7e5_20 format numbers. The floating point format provides a natural 
perceptual performance in much the same way as provided for the degamma process. FIG. 16 
shows tiie ability to discriminate between each increment of the floating point format 141. As an 
example, a system having 145fL peak white with 2000: 1 contirast ratio is used. Curve 143 is a 
traditional limit of luminance differences. As can be seen, tiie floating point format is well 
below tills level. The van Ness curve 145 provides a lower bounce on perceptual performance 
given the image is a sign wave grading tuned to have maximum perceptibility at a given 
luminance level. Only the upper code levels exceed tiiis threshold. One additional mantissa bit 
would move below this level. 

[0071] Referring now to FIG. 17, there is shown a block diagram of tiie circuitry 33 for 
providing a complete algoritiim for operating a DMD display system incorporating tiie present 
TI-35625 -26- 



invention. As shown, R. G and B input signals 151, 153 and 155 are provided to a primary pulse 
select circuit 157 to be discussed hereinafter for each pixel of a display frame. 
[0072] As will be appreciated by those skilled in the art, an energy pulse or burst is typically 
applied periodically to a high intensity light source to increase the Ufe of the light source. The 
energy pulse must of course be precisely scheduled so that it can be anticipated and compensated 
for or an artifact of a momentary increase in a single color of Ught would occur. One easy way 
to handle the increased light would be simply to turn off all of the mirrors during the burst of 
increased light. However, rather than wasting this increased light output by pulsing the light 
source when all the mirrors are off, the timing of the energy pulses according to this invention 
are controlled by circuitry 157 so that the Ught increases or gains are scheduled to occur as a 
selected one of the primary R, G or B wheel sectors are intersecting the Ught beam firom source 
1 1 as shown in ¥IG. 1. Altematively, multiple energy pulses could be selected during different 
color wheel sectors. It is also noted that since the light output of these extra pulses can change or 
be changed over time, the strict scheduling of the light pulse allows tiie increased Ught output to 
be calibrated to assure the proper bits are selected. 

[0073] Thus, the required gain for the input signal is determined, and the output signal 
generated with one to four primary color pulse bits, and when the color signal(s) required by the 
output signals will exceed the brightness level available by use of all of the normal or primary 
bits, tiie pulse bits may be turned on and used to achieve the necessary dynamic range as 
requested by the input signal. 

[0074] As shown in HGs. 18 and 19, up to four levels of color increase can be specified for 
each of die primary colors by tiie 'Two Level Binary Search" circuits. The determined gain 

p 

needed by each primary color is applied to tiie input video signal. A lookup table with N 
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storage locations, (where "N" is the number of bits in the input signal, and "P" is the number of 
primary colors), could be used to directly determine what gain value, if any, is appropriate. 
Instead however, a 2-level binary search is used, m hardware binary search looks for primary 
pulse bit levels, which exceed the delta amount over the nominal 255 bits. The level is 
subtracted and the patterning information is passed to the WSSP (White Secondary Spoke 
Primary) block. T^us, it is seen that a two-level binary search results in four possible outputs as 
illustrated by the binary search tree for the red pulse as shown in FIG. 19. 
[0075] Of course, as discussed above, a straightforward method for indexing the 3D LUT 
would be to use the R, G and B values direcUy. However, another method of indexing into the 
3D LUT particularly suitable for the present invention is to use color ratios. The color ratios 
provide a mechanism for dividing tiie color space into regions, which are not dependant upon the 
size of the input values. Tlie color ratios are defined as the ratios of the three primary colors and 
include G/R, B/R, and B/G. It will also be appreciated tiiat the inverse of these ratios, including 
R/G, Rm and G/B may be used. Therefore, the red, green or blue signals 151, 153 and 155 are 
also provided to a color ratio calculation circuitry 161. color ratio calculation circuitiy 161 
provides the system with the ability to select color ratio indexing into the 3D LUT. 
[0076] Referring now to FIG. 20, there is shown how the input ratios R/G and /GR may be 
used to cover the complete spectrum of ratios of these two colors. For example, if only one of 
the color ratios, such as G/R were to be used, the range of the ratio would be 0 to infinity, which, 
as will be appreciated, that from a matiiematical point of view could present difficulties at the 
two extremes of the ratios. However, by using ti.e two ratios, tiie range can be limited from 0 to 
1 and I to 0. As shown in FIG. 20, the green values are on the vertical axis 163 and the red 
values are on the horizontal axis 165. Une 167 represents the point where both the red and green 
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values are equal. Tim, If the R/G ratio is equal to ♦ (phi) and the G/R raUo is equal to 6 (theta). 
ten line 167 represents the point at which the ratio equals l:e=*=l . The denominator of the 
ratio IS defined to always be the larger of the two numbers. A ratio flag is used to define which 
ratio is being used. TOus, in order to efflcientty cover the color space with points in the 3D LOT. 
only two ratios are needed along with the maximum of the input ROB signals. A, this point, the 
hardware will evaluate the raUo and set the raUo flag to "1" or depending upon whether the 
appropriate ratio is R/G or GIK as shown in Table 2. However, smce the ratio must take the 
place of one of fl.e R, G or B signals for indering into the 3D LOT, the two ratios are merged 
into a single index value. TWs may be accomplished by subtracting the G/R ratio or 6 value 
from 2. Thus, RA3 or * ratio will range from "Or to "l" and G/R ratios or e will range from "1" 
to "2." 

[00771 Therefore, referring now to FIG. 21, the three possible results are defined by the 
common color between the ratios, FIG.21 shows the color ratio block 161 wiflrared input 
151a, a green input 153a and a blue input I55a as received from "Primary Pulse Select" circuitty 
157. The outputs are mapped to three channels including tt>e X channel, titc Y chamtel and the Z 
channel in response toaselectton signal input on line ,69 and as defined in Table 3. Likewise, 
as discussed above, the X and Y ratio flags and the selection input on line 169 are determined as 
set out in Table 2. 



sel 



2 



3 




0 



ifG<R^OeIse-»l 



ifR<G-^Oelse-*l 



if R<B -^Oelse 
Table 2. 



4 



if B<R-^Oelse-^l 



if B<G ->■ 0 else -^1 



if G<B-^Oelse-*l 
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sel - ■ 



G/R,R/G 



R/G,G/R 



R/B,B/R 



B/R,R/B 



B/G, G/B 



G/B, B/G 



B 



max(R,G,B) 



inax(R.G,B) 



max(R,G,B) 



Table 3. 

[0078] Further, concerning the above discussion related to FIG. 13, three single dimension 
LUT's are used as the inputs to a three dimensional LUT. In the example of FIG. 13, the three 
single dimensional LUT's includ a single dimension red LUT, a single dimension green LUT 
and a single dimension blue LUT. These three single dimension LUT's were used to map into a 
3D LUT (three dimensional look-up table). However, according to the embodiment of the 
present invention shown in FIG. 17, and as was discussed with respect to FIGs. 20 and 21, the R, 
G and B color signals have been transformed into gR, gG and gB or gain signals for R, G and B 
and identified as X, Y and Z signals respectively. Therefore, as indicated by the 3D input LUT 
circuitry 171 of FIG. 17, instead of the three single dimension R, G and B look-up table, the 
embodiment of HG. 17 includes three single dimension LUT's 173, 175 and 177, respectively, 
for the X, Y and Z signals representing the red gain, the green gain and the blue gain signals as 
illustrated in FIG. 22. The X, Y and Z inputs are on lines 179, 181 and 183, respectively, shown 
in HG. 22. The output of LUT's 173, 175 and 177 on lines 185, 187 and 189 are the base cube 
values such as "XO", "YO" and "ZO" in the first floating point format discussed above, and the 
"inverse distance across" the selected cube such as 1/Xl-XO, 1/Yl-YO and 1/Zl-ZO on Unes 191, 
193 and 195, respectively. An "index number" such as Xindex, Yi„dex and Zmdex are provided on 
lines 197, 199 and 201. These "index" numbers simply identify the appropriate cube from cube 
"0" to cube "14" (in a 16 cube embodiment). Cube index number "15" (16* cube) is only used 
to define the upper limits for points in cube "14" (i.e., the 15* cube). Further, in order to reduce 
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the size of the LUT memory, each of the single dimensions, X, Y and ZLUT's is implemented 
by using a four stage binary search as indicated in FIG. 23. 

[0079] The zero indexes of the LUT's are always set to zero. Thus, once the binary search, 
as indicated in FIG. 23, identifies an index, a normalized delta value "XNdelt" for the "X" 
circuitry 205 as indicated on line 203 is calculated. This calculated value is the percentage of the 
step used in the "X" channel. For the "X" chamiel, the value XNdelt is equal to (X-X0) (1/(X1- 
XO)). The process for the Y and Z channels proceed in the same manner and is carried out by 
circuits 207 and 209. It should be noted that the index search will produce an index in the range 
of 0 to 14 for proper addressing into the 3D LUT to be discussed hereinafter. Thus, the decision 
logic (not shown) for the binary search uses the input to the base index to compare logic along 
with a "table flag" and the "ratio flag" signal as discussed above with respect to the "Color Ratio 
Calculation" circuitry 161 and illustrated witii respect to FIGs. 20 and 21. Table 4 shows the 
logic process using this input and the flags with respect to the X and Y channels. A similar table 
is not necessary for the Z channel since "if Zi<X then TRUE else FALSE." Therefore the X and 
Y channels, the ratio flag and the table flag (stored in the table) are used to determine the logic 
transversing the binary tree of FIG. 23. 



0 



0 



0 



if Yi^X -» TRUE else -» FALSE 



FALSE 



0 



TRUE 



if X<Xi ^ TRUE else FALSE 



0 



0 



if Yi<Y TRUE else FALSE 



0 



FALSE 



0 



ifY<Yi 



TRUE 

TRUE else FALSE 



Table 4. 
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[0080] The mapping of 3D LUT cells to memory locations will be described with respect to 
FIG. 24. Each LUT cell referenced by the X, Y and Z indexes of FIG. 24 corresponds to one 
memory location identified by a bank number (0 to 4) as the first digit. The first digit or "bank 
number" is followed by a 3 digit address into that bank. The figure shows some of the cells with 
their memory locations in the format, "b.aaa" where "b" is the bank number and "aaa" is the 
address into the bank. For simplicity only a portion of the addresses for the perimeter cells 
shown in FIG. 24 have numbers or addresses. However, in actaal use each cell would include an 
address. For example, for X=13, Y=0 and Z=5, the address found is 3.258. Thus, the 
appropriate gain address may be found in bank "3" and address "258." This addressing scheme 
is arranged so that an incremental cell step in any dimension accesses the next memory bank in 
Modulo 5 order. As will be appreciated by one skilled in the art. Modulo 5 counting only uses 4 
of the 5 memory banks at any one time. Therefore, once a base memory bank is selected, the 
next 4 banks are used in order with a wrap-around to bank "0." For example, if bank 3 is 
selected as the base memory bank, the order of the next 3 banks would be 4, 0 and 1. 

[0081] Referring again to FIGs. 14 and 15 along with FIG. 24, for gain interpolation, as 
shown, the four cells that correspond to the Tetrahedron comers, designated A, B, C and D, are 
related by a series of three one-dimensional increments. Comer A is the cell identified by the X, 
Y and Z indexes. Comer B is the cell offset from A by one in the direction of the channel with 
the maximum normalized delta value. Comer C is the cell offset from B by one in the direction 
of the channel with the median normalized delta value. Comer D is the cell offset from C by one 
in the direction of the channel with the minimum normalized delta value. The 3D LUT data for 
the four tetrahedron comers are thus always in four different memory banks numbered 
sequentially for A, B, C and D. 
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[0082] The address in the bank changes differently depending on the channel axis direction. 
Except for bank rollovers (the bank number going from 4 to 0), an increment in the X direction 
does not change the address. Incrementing in the Y direction adds 3 to the address while the Z 
direction adds 51. Any time a movement to an adjacent cell causes a bank rollover, an additional 
1 must be added to the address. 

SI = sum of indexes = Xindex + Yindex + Zindex 
BankA = bank for comer A = SI mod 5 
BankB = (BankA + 1) mod 5 
BankC = (BankB + 1) mod 5 

BankD = (BankC + \)mod5 ^. ^ * ri ^ • ./ct\o 

AddrA = address for corner A = Yindex * 3 + Zindex * 51 + mf(SI\5) 

^"^"^Viraroeltismax | 3 if YNDelt is max | 51 is ZNDeltis max] + 
[0ifBankA<4 | lifBankA = = 4] 

^'^^"if^Deltismed | 3 if YNDelt is med | 51 is ZNDeltis med] + 

[0 if BankB < 4 | if BankB = = 4] 
AddrD^-AddrC^+ | 3 if YNDelt is min | 51 is ZNDeltis min]+ 

[0 if BankC < 4 | 1 if BankC = = 4] 

[0083] The 3D LUT interpolation circuitry 215 requires four values form the XYZ cube 
(similar to RGB cube of HG. 13) to interpolate the output gain value. The cube size shown in 
HG. 24 ofthe memory 213 of FIG. 17 is set to be 16x16x16. This requires 4096 memory words. 
Further, the memory 213 for the 3D LUT is arranged into 5 independentiy addressed banks 213a, 
213b, 213c, 213d and 213e with at least 820 words each. One implementation using commonly 
available memory modules would provide 832 words per bank realized with 3 memories of 512 
+ 256 + 64. 

[0084] The 3D interpolation requires the normaUzed delta values used to search the 3D 
input LUT and the color gains for each color from memory. Tlie normalized delta values are of 
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floating point type, FP_7e5_20, and the gain values are of floating point type, PFP_7e2_l. the 
resultant gain is of format, FP_7e5_20. 

[0085] Referring again to the discussion of tetrahedral interpolation of FIGs. 14 and 15, the 
equation for gain can be restructured to simplify calculations by avoiding negative intermediate 
results: 

gcixj.z) = gCAVO-MaxNDelt)+ 

gCB*{MaxNDelt-MedNDelt)+ 
gcc*{MedNDelt-MinNDelt)+ 
gCD*MiNDelt 

where gCQ is the 3D LUT gain for color c and the cube comer Q and MaxNDelt, MedNDelt, and 
MiNDelt are the maximum, median and minimum normalized delta values, respectively, for X, Y 
and Z. Tlie cube comer designations A, B, C and D were defined and discussed above with 
respect to HGs. 14 and 15 and tiie 3D LUT Address Generation. 

[0086] The outputs of the 3D LUT interpolation are an output value for each primary color 
and a search order control signal retrieved from memory for cube comer A. The output value for 
a color is that color's input multiplied by its calculated gain value. Tlie search order control 
signal defines the search order as shown in Table 5. 
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Table 5. 



[0087] As shown in FIG. 25, the dynamic range adjustment function or circuit 217 looks at 
the gained R, G and B signals 219, 221 and 223, and if any of these signals are greater than the 
normal dynamic range of the DMD display (i.e., total of all 0-255 bits), then the out of range 
signal will be adjusted by the use of a white, secondary, pulse or spoke bit as determined by 
circuit 217. However, in order to save memory space, all combinations of white, secondary, 
pulse and spoke bits are not stored. Instead, binary searches are used to locate the largest 
element in bit groups that can be used to adjust the out-of-range signal. The white (225), cyan 
(227), magenta (229) and yellow (231) tables are all searched, but they must be searched in a 
different order for each pixel. This order is driven by the output of the 3D LUT, using the 
"Bit.Guide" signal 233. 

[0088] Each of the equivalent RGB tables are filled with values which are in increasing 
intensity order. For example, for the white table, the levels would be in the order that would be 
seen turning on along a white ramp. Each of the secondary colors would follow a similar 
method. 
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[0089] A binary search is conducted through each of the white, cyan, magenta and yellow 
tables by the first four "5 Level Binary Search" circuits 235, 237, 239 and 241. The block 
diagram of HG. 26 illustrates the five level search and FIG. 27 Ulustrates the five level binary 
search tree. The order is determined by the search order index. Each stage finds the equivalent 
R, G, B to be substituted and sets the Xbit number for that color, (where X=W,C,Y,M). The 
equivalent R, G, B value is subtracted from the R, G, B input and the result is passed to the next 
search engine. 

[0090] The output from dynamic range adjust is clipped to be within the range of 0 to 255 
by "Umiter" circuit 243. Clip counters are provided on each of the R, G and B channels, which 
count the number of times the respective channel, limits the output value. These are available to 
be read by the processor and can be used to determine how well the 3D LUT is mapping the 
output values or are there error conditions. It can also be used by tiie dynamic aperture to 
determine how many values are being clipped in each channel. 

[0091] The WSSP (White Secondary Spoke Primary) bit pattern function 245 and illusti-ated 
in FIGs. 28 and 29 provides for the creation of individual bit plane signals for the white, 
secondary, spoke and pulse bits, and operates similarly to spoke light recapture (SLR) of 
previous techniques. Four 5 bit numbers on lines 247, 249, 251 and 253, (one for each of white, 
cyan, magenta and yellow respectively) are passed into the functions 255, 257, 259 and 261 from 
the previous dynamic range adjust function 217. Each individual input drives a 32x50 look-up 
table from which the signals drive the pattern generator and bit plane generation functions. 
[0092] The pattem and bit generator function of HG. 29 provides two basic groups of 
patteming. The spoke bit group processing (SBG) provides for the patteming of white or 
secondary color bits in spatial patterns of up to 4x4. The white SBG processing can contirol up to 
TI-35625 -36- 



16 bits with spatial patterns from 1x1 to 4x4. The secondary color SBG processing each control 
6 bits and use patterns from 1x1 or 2x2. 

[0093] The pure bit processing for white and secondary colors provides for the mixing of 
bits using spatial/temporal patterns. Either structured or blue noise patterns can be used. The 
white processing controls 1 1 bits while the secondary colors control 6 bits each. 

[0094] Although the present invention and its advantages have been described in detail, it 
should be understood that various changes, substitutions and alterations can be made herein 
without departing from the spirit and scope of the invention as defined by the appended claims. 
For example, many of the features and functions discussed above can be implemented in 
software, hardware, or firmware, or a combination thereof. 

[0095] Moreover, the scope of the present application is not intended to be limited to the 
particular embodiments of the process, machine, means, methods and steps described in the 
specification. As one of ordinary skill in the art will readily appreciate from the disclosure of the 
present invention, processes, means, methods, or steps, presently existing or later to be 
developed, that perform substantially the same function or achieve substantially the same result 
as the corresponding embodiments described herein may be utilized according to the present 
invention. Accordingly, the appended claims are intended to include within their scope such 
processes, means, methods, or steps. 
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